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Abstract. We consider the problem of controlling marginally stable linear sys- 
tems using bounded control inputs for networked control settings in which the 
communication channel between the remote controller and the system is unreli- 
able. We assume that the states are perfectly observed, but the control inputs are 
transmitted over a noisy communication channel. Under mild hypotheses on the 
noise introduced by the control communication channel and large enough control 
authority, we construct a control policy that renders the state of the closed-loop 
system mean-square bounded. 



1. Introduction 

Communication channels have become ubiquitous in control applications such 
as remotely operated robotic systems [Hokayem and Spong, 2006]. In such ap- 
plications, measurement and control signals are exchanged via a lossy and noisy 
communication channels, which makes the system a networked control system (NCS). 
The research in NCS has branched into many different directions that deal with 
the effects of delays, limited information exchanged, and information losses on the 
stability of the plant, see, e.g., [Nair et al., 2007] and the references therein. 

Control under information loss in the communication channel has been ex- 
tensively studied within the Linear Quadratic Gaussian (LQG) framework [Imer 
et al., 2006; Schenato et al., 2007]. Typically, the commimication channel(s) are 
modeled by an independent and identically distributed (i.i.d) Bernoulli process, 
which assign probabilities to the successful transmission of packets. Perhaps the 
most well known result in this setting is: When the transmission of sensor and 
control data packets happens over a network with TCP-like protocols, the closed- 
loop system under LQG controller can be mean-square stabilized provided that 
the probabilities of successful transmission are above a certain threshold. Since the 
TCP-like protocols enable the receiver to obtain an acknowledgment of whether 
or not the packets were successfully transmitted, the separation principle holds 
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and the optimal LQG controller is linear in the estimated state. Thus, this result 
is a proper generalization of the classical LQG control problem to the networked 
control setting. 

Within the LQG setting, control inputs are not assumed bounded and therefore 
linear state feedback is a permissible and optimal strategy. However, guaranteeing 
hard bounds on the control inputs is of paramount importance in applications. 
Consequently, many researchers have pursued the problem of optimal control 
and stabilization for linear systems with bounded control inputs [Bernstein and 
Michel, 1995; Saberi et al., 1999; Toivonen, 1983; Wonham and Cashman, 1969]. 
This problem has also received a renewed interest in recent years [Chatterjee et al., 
2009; Digailova and Kurzhanskii, 2004; Hokayem et al., 2009; Ramponi et al., 2009; 
Wang and Boyd, 2009]. In the deterministic setting, it is well-known [Yang et al., 
1997] that global asymptotic stabilization of a linear system Xf+j = Axf + But is 
possible if and only if the pair {A, B) is stabilizable under arbitrary controls and the 
spectral radius of the system matrix A is at most 1 . In the stochastic setting, it was 
argued in [Nair and Evans, 2004] that ensuring a mean-square bound for every 
initial condition is not possible for linear systems with bounded control elements 
if the system matrix A is unstable. In [Ramponi et al., 2009] we established the 
existence of a policy with sufficiently large control authority that ensures mean- 
square botmdedness of the states of the system under the assumption that A is 
Lyapunov stable. Although Lyapunov stability of A is a stronger requirement than 
the spectral radius of A being at most 1, to the best of our knowledge, this is the 
current state of the art. 

In this article we generalize the results of [Ramponi et al., 2009] to incorporate 
noisy control channels. We consider mean-square boundedness of stochastic linear 
systems imder the following specification: 

o the communication channel between the controller and the system actuators is 
noisy whereas the commimication channel between sensors and controller is 
noiseless, and 

o hard constraints on the control inputs must be satisfied. 

We are thus concerned with a networked setting as proposed in [Elia, 2005; 
Garone et al., 2007; Schenato et al., 2007] when generalized to incorporate boimded 
control inputs [Ramponi et al., 2009]. The control input m''^ for the f-th plant is com- 
municated to the corresponding plant actuator via a lossy communication channel, 
which is characterized by the noise v*'' affecting the control input multiplicatively 
as shown in Figure 1. We assume that the states are perfectly observed and are 
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Figure 1. Topology of the control system. 



transmitted to the controller without any loss. 
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Notation. For any random vector v let /i,, := E[v] denote its mean and Oy := 

var(v) := e|^||v - jUv||^] denote its second moment. For a matrix M we let ||M|| 
denote the induced Euclidean norm of M. We shall employ the standard notation 
diam(S) sup^, ^^^g ||x - to denote the diameter of a subset S of Euclidean space. 
For n e N, by 1„ we denote a vector of length n with all entries equal to 1. For r > 
and M e N, define the saturation function 

Iz if ||z|| < r 

elR". 
rz/ \\z\\ otherwise 

The remainder of this article is organized as follows. In §2 we formalize the 
main problem with all the underlying assumptions, and in §3 we state the main 
results. The proofs are provided in §4. 

2. Problem Setup 

Consider the following discrete-time stochastic linear system subjected to packet 
drops in the control communication channel 

Xf+i = Axf + But + Wt, 

(2) . ^ te^o, 

where Xt e IR'' is the state, Ut e IR'" is the control input, A e ]R'*^'* is the dynamics 
matrix, B e ]Rrfx™ jg the input matrix, (iff)t€No IR'^-valued random process 

noise, and {vt)teKo is an R"'-valued random process modelling the uncertainty 
in the control communication channel, and O denotes the Schur or Hadamard 
product of matrices.^ The initial condition xg = x is given and the state Xt is 
perfectly observed by the controller. 

The controller determines the control input Ut based on the history of k states 
Xt^t ■= {xt-k+i,---,Xt-i,Xt). (For t = 0,...,k-2,Xt^k ■= (xq, . . . ,Xo ,Xo,Xi, . . . ,Xf)-) The 

(A:-l-f)-tiines 

controller S5mthesizes a deterministic control policy n = {nt)teNg which maps the 
states vector X into a control set 'U. To wit, 

Ut = 7Tf(X,,t), t e No, 

where the maps Tif : M.'^'^ — > H c R'", t e No, are Borel measurable. Such a control 
policy 71 is known as a k-history dependent policy. The control set 'W is assumed to 
be nonempty, compact, and containing the origin. Any control policy n = (7Tt)feNo 
which guarantees that the control input sequence (Mf)feNo satisfies 

(3) M, e 1/, te No, 

is called an admissible k-history dependent policy. In many practical situations in- 
volving saturating actuators and hard bounds on control inputs, 'U is chosen to be 
a ball, i.e., 

(4) ^^-{ze R" I llzll ^ Uma.}, 

where Umax > is called the control authority available to the controller. 

^Recall [Bernstein, 2009, p. 444] that if M', M" are rii x n2 matrices with real entries, then M' M" 
is the rii x 112 matrix defined by (M' M")/,y := {M')i^j{M")q. 
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Our control objective is to synthesize an admissible A:-history dependent policy 
which ensures that the second moment of the closed-loop system, for any initial 
condition x e M", 

(5) Xf+i = Axt + Bvt O 7if(Xyc) + wt, t e No, 

remains bounded for all t e Nq. We shall focus on the following problem: 

Problem 2.1. Find, if possible, a control authority Lfmax and an admissible policy 
71 = {nt)teKo with control authority Umax/ such that the following condition holds: 
for every initial condition xq = x e W' there exists a constant C > 
such that the closed-loop system (5) satisfies Ej[||Xf|p] < C, for all 
f eNo. 

In practice, a performance index that accounts for the average sum of cost- 
per-stage functions (involving the state and control inputs) of the system is often 
required to be minimized; however, in this article we are only concerned with the 
stability property defined in Problem 2.1. 

We shall make the following standing h5^otheses: 

Assumption 2.2. 

(i) The matrix A is Lyapunov stable, i.e., all the eigenvalues of A lie in the closed 
unit circle, and all eigenvalues A satisfying |A| = 1 have equal algebraic and 
geometric multiplicities. 

(ii) The pair {A, B) is stabilizable. 

(iii) The process noise (w^teNo is an independent sequence, and has bounded 
fourth moment, i.e., C4 := sup^^j.^^ E[||zyf||'*] < 00. 

(iv) The control input sequence (Mf)feNo satisfies (3) and (4). 

(v) The control channel noise {vt)teNo is i.i.d. ❖ 

It follows from Assumption 2.2-(iii) that there exists Ci > such that E[||z<;f||] < Ci 
for all t e Nq. (For instance, Jensen's inequality shows that Cj < ) Note also 
that Assumption 2.2-(iii) does not require that the process noise vectors {zvt)teN^ be 
identically distributed. The assumption of mutual independence of {wt)t€K„ can 
also be relaxed, but we shall not pursue this line of generalization here. 

Without any loss of generality, we also assume that A is in real Jordan canonical 
form (cf. [Nair and Evans, 2004]). Indeed, given a linear system described by 
system matrices {A, B), there exists a coordinate transformation in the state-space 
that brings the pair {A,B) to the pair (A,B), where A is in real Jordan form [Horn 
and Johnson, 1990, p. 150]. In particular, choosing a suitable ordering of the 

Jordan blocks, we can ensure that the pair (A, B) has the form 

where Ai e K''i^''i is Schur stable, and A2 e K'^sxrfz j-i^g eigenvalues on the 
unit circle. By Assumption 2.2-(i), A2 is therefore block-diagonal with elements 
on the diagonal being either ±1 or 2 x 2 rotation matrices. As a consequence, A2 
is orthogonal. Moreover, since (A, B) is stabilizable by Assumption 2.2-(ii), the 
pair (A2,B2) must be reachable in a number of steps k ^ ^2 that depends on the 
dimension of A2 and the structure of (A2,B2), i.e., rank(9i,,-(A2,B2)) = ^2, where 

K{A2,B2)-[A^f'B2 ■■■ A2B2 B2]. 

The smallest such k is called the controllability index of {A2, B2) and is fixed through- 
out the rest of this article. Summing up, we can start by considering that the state 
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equation (2) has the form 



(6) 



Ut + 



r (I)' 

(2) 



where A\ is Schur stable, A2 is orthogonal, and the subsystem {A2, B2) is reachable 
in K steps. Since the matrix 3?,,(A2,B2) has rank full rank, its Moore-Penrose 
pseudoinverse exists and is given by 

%M2,B2r - 5R„(A2,B2)T(91.(A2,B2)5R,c(A2,B2)T)"\ 

3. Main Results 

We are ready to state the main result pertaining to the existence of policy of 
bounded authority that renders the state of the system (2) mean-square bounded. 
Let us define the normalized measure of dispersion or the noise-to-signal ratio of 

the channel W := -y/cj^ ■ max,=i^... „, \{j^v)i\ ^- We impose the following additional 
requirements: 

Assumption 3.1. In addition to Assumption 2.2 we stipulate that: 
(vi) The control channel noise has bounded range, i.e., Vq e T, where T is a 

bounded subset of ]R"', and that /.i,, has nonzero entries, 
(vii) The following two technical conditions hold: 
(vii.a) KW\\^,{A2,B2y\\\\')lM2,B2)\\ < 1. 

ViECi (max,=i „ |(Mv),f ') P.(A2,B2)+|| ||5R,,(A2,l2)ll 



(vii.b) Un 



1-K^||%,(A2,B2)1|||3?,(A2,B2) 



Proposition 3.2. Consider the system (2), and suppose that Assumption 3.1 holds. 
Then there exists a K-history dependent policy n :- {nt)teKg with control authority 
at most Umax (see (12) below), such that for every initial condition x there exists a 
constant L, = L,{x, k, ^v, ^,C\) > with 

E.v[||^flP] ^ C for a77fe No 

in closed-loop. 

Remark 3.3. Proposition 3.2 assumes minimal structure from the set in which the 
control channel noise takes its values. In particular, we do not assume that the 
control channel noise takes values in a finite set — in fact, T may be uncountable. 
(While the standard choice of modelling uncertainty in the control channels has 
focussed on a multiplicative Bernoulli {0, 1} random variable multiplying the entire 
control vector, there are cases in which the uncertainty model considered in (2) (i.e., 
different random variables multiplying the components of the controller,) makes 
sense. For instance, the standard processes of control quantization or "binning" 
can be viewed as introducing uncertainty to the controller — components of the 
controller being multiplied by bounded but not necessarily identically distributed 
random variables; the set T has the natural interpretation of the "largest bin.") In 
view of this. Assumption 3.1-(vii.a) is a technical condition stipulated as a trade-off 
for the absence of any further structure in the set T. < 

In §4 we prove Proposition 3.2 by a constructive method. It turns out that 
our policy (see (12) below) is derived from the 7c-subsampled system (x^-f),^]^;,, 
and is K-history dependent. To wit, for each n e No, at time kw, based on the 
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state Xai, the policy synthesizes a K-long sequence of control values for time steps 
xn, KM + 1, ... , K{n + 1) - 1. 

Let us assume that the same imcertainty enters all the control channels, i.e., 
Uf - VfUf, where Vf e R. The structure of our control policy permits us to transmit 
the control data packets in a single burst each k steps. This however, necessitates 
the presence of a buffer at the actuator end of the plant to store the k control values 
{vKnUxn/VKnUKn+i, ■ ■ ■ /^K«MK(n+i)-i} transferred in a burst at time xn, such that at each 
time t e (km, . . . , x{n + 1) - 1}, the control v^nUt can be applied. 

Assumption 3.4. In addition to Assumption 2.2, we assume that: 

(vi') Control signals are sent to the actuator every k steps, and for each t e No, 
the control channel noise is of the form v^t'^an, with v^„ e {0, 1} and P(Vk-„ = 
1) = p e ]0, 1[ for each n e Nq. 
(vii') U„ax > V^Ci mMi^Bin P.(A2,l2)ll IV- 

Proposition 3.5. Consider the system (2), and suppose that Assumption 3.4 holds. 
Then there exists a x-history dependent policy n :- {nt)t€Kf, with control authority 
at most Umax (see (13) below), such that for every initial condition x there exists a 
constant Q' = Q'{x,K,p,Ci) > with 

Ex[l|Xf||'] ^ C for ante -No 

in closed-loop. 

Remark 3.6. We noted in Remark 3.3 that Proposition 3.2 assumes minimal structure 
from the bounded set T. In contrast. Proposition 3.5 assumes a rather specific 
structure of the set T — that it consists of two elements (note that v^,, e {0,1} for 
each n e No in Assumption 3.4-(vi')). The i.i.d Bernoulli assumption on (v^OfeNo 
leads to a simpler description of the control authority Umax in Assumption 3.4-(vii') 
compared to Assumption 3.1-(vii.b), and the analog of Assumption 3.1-(vii.a) is 
not required here. < 

As promised in Remark 3.3, we provide a simple scalar example illustrating 
some effects of varying the probability of transmission of the control signal. 

Example 3.7. Consider the scalar system Xt+i = Xt + Ut + Wt, t ^ 0, with initial 
condition xo = x, Ut = viUt. Suppose that (vf)te]N|, is i.i.d Bernoulli (0,1} with 
P(vt = 1) = p > 0, and let (iff )te]No be i.i.d, and satisfy sup jgj^^ E[|a;f|*] = < oo. This 
implies, in particular, that sup^^j^^ E[|a;f|] ^ ^ -sJC^- Suppose that Umax > C^/p, 
where Wf e [-Umax/ Umax] for all t. With this much data it is easy to verify the 
conditions of Assumption 3.4. We conclude by Proposition 3.5 that there exists a 
policy with control authority at most Umax such that the system is mean-square 
bounded. In fact, we see that for every nonzero probability p of transmission 
of the control signal, there exists a control authority Umax > and a policy with 
control authority at most Umax/ under which the state of the system is mean-square 
bounded. A 

Remark 3.8. Notice that Proposition 3.5 does not contradict the main results of 
[Schenato et al., 2007], where it was proved (see [Schenato et al., 2007, Lemma 5.4]) 
that there exists a threshold probability of i.i.d. Bernoulli packet drops such that a 
stabilizing linear feedback for unstable linear systems can be found provided the 
drop probability is less than that threshold. Indeed, in Assumption 2.2 we have 
specifically ruled out unstable A. < 
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4. Proofs of Propositions 3.2 and 3.5 



For our proofs of Propositions 3.2 and 3.5 we shall employ the following imme- 
diate adaptation of [Pemantle and Rosenthal, 1999, Theorem 1] on L2 bounds of 
nonnegative random variables: 

Proposition 4.1 ([Pemantle and Rosenthal, 1999]). Let (Q, g, P) be a probability 
space, and let (gf)(eNo be a filtration on (Q, 5, P). Suppose that {^t)teNo is a family of 
nonnegative random variables adapted to (gOteNo/ such that there exist constants 
a,M,} > such that £,0 < }, and for all t e No, 



E«'[5f+i - ^t] < -a on the set {4, > /}, 

|4 



(7) 

(8) E[|6+i-6n«o,.--,6] ^M. 

Then there exists c = c{a,},M} > such that sup E^^^f j ^ c. 



teNo 



In what follows we let I2 denote the ^2 x ^2 identity matrix. 

Lemma 4.2. Given the system (2), suppose that Assumption 2.2 holds, and consider 
the decomposition (6). Let gf be the o-algebra generated by {xt)teNg, i.e., gt := 
a{x„; n = 0, . . . , f) for each t e Nq. Then fhere exists a,J>0 such that 



(t+i) 



IK? II] ^ set { II > /} for all t e No 



Proof. To simplify notation we first write compactly 
(9) 



VKt ■ = 



VKt 
VKt+l 



and UKt ■= 



VK{t+l)-l 

It follows from the system dynamics that 



UKt 

MkJ+I 



MK(t+l)-I 



K(t+1) 



A^xf/ + %M2,B2)UKt + %c{A2,l2)zV 



(2) 

Kt:K(t+l)-l' 



teNo, 



where zv 



(2) 

Kf:K(f+l)-I ■ 



K(t+1)\ 



S'll] 



. Therefore, 



- X 



ES-[ Aj^xlf^' +5R,(A2,B2)m., +9i,(A2,l2)a^|f 



lc(f+I)-I 



< E^-[\\a-,x^^ +^K{A2,B2)uKt\\ - \\x^S\\\ + W'MMJin E[||zi;|f)^(,^^)_J] 

< ES-[||A2^x|f^' +9?,(A2,B2)m.,|| - ||x|f,'||] + V^Z ||9i,(A2, 12)11 Ci. 



Since A2 is orthogonal, we have||A^x|f/|| = \\x^^^'\\. We require UKt be ^Kf-measurable. 
Employing Jensen's inequality and sublinearity of the square-root function, we get 

ES-[||A^x|f/+9l,,(A2,B2)M.f||] 

< ^Er*.'[||A^-xP'+9l„(A2,B2)M,-t|f] 

= (||x|f^f + 2(xP')\A^^)X(A2,B2)(ER-[v,rf] OM,0 



(2)1 
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+ E»-[(9i„(A2,B2)(v,f OM,,t))^(9?,(A2,B2)(v,, OM,0)])'^' 
< llAj^x^f + 9?,,(A2,B2)(E»-[Vk.*] OMkOII 

+ 7ESK.[p,(A2,B2)(v,t OM,,f)ll'] - ||9?.(A2,B2)(E5-[v,,] OM,,0||', 

The last term under the square-root is simply the conditional variance of the vector 
9?k(A2, B2)(Vri O u^t) given . Since (v„),';f is independent of g^, v := E^^> [v,,,] 
is a constant, and equals vec{jj-v, ■■ ■, f/v}-) Thus, we see that 



(10) 



< ||A^x|f,' + 9l,,(A2,B2)(vOM,,)|| + ^|E^mK{A2,B2){{v,t - v) Om.0II'] 

< WA^X^^^ + %M2,B2){V O M,rf)|| + ^f^\\%M2,B2)\\ Umax ^E^- [l|v,f - V||'] 

< fA^^xf) +91,,(A2,B2)(V0M,,)|| + K||3?,(A2,B2)|| Um,.^/^,■ 

Collecting the inequalities above, we see that 

~ ll^^^ll] ^ IK^S' + 3iK(A2,B2)(vOMK-0|| - IK^I'^II 

+ k(P,(A2,B2)|| U^x + P,c(A2,-r2)ll Ci/ V^). 
In view of Assumption 3.1-(vii.a) we see that there exists < u '.— Llmax^l ~ 
K^||3?,(A2,B2)1| ||9i,(A2,B2)||)- ^f^C^ I max ||9?.(A2,B2)1| ||9i,,(A2,l2)l|. We 

' \ !=l,...,m / 

now define 

(11) r:^a + k{\\%M2,B2)\\ Umax + P,c(A2,l2)ll Cj/ V^) < Umax- 

By Assumption 3.1-(vi), every entry of v is nonzero; we let v^~^' be the vector of 
reciprocals of each entry of t> (i.e., (v'~^')/ = (v/)~^ for each i). We define our control 
policy' 

(12) M,f M,,,(x['/) -9?„(A2, B2)^ sat,,(A^x|f) ) O v'-D, 

where sat, is the function defined in (1). Clearly, 1/,^ is gftririeasurable. Substituting 
into (10) we see that 

E""[||^K(ll)|| - ¥M ^ + k(Pk-(A2,B2)|| Umax + 1^^2,12)11 Cl/ V^) 

on the set | > r| 

< -a on the set > r|, 

where the last inequality follows from the definition of r above. 

Thus, it only remains to see that the control policy defined in (12) satisfies the 
bound llUfll < Lfmax for each t. But in view of the definition of r in (11) and our 

policy (12), we see that ||MKtl| < J'PK(^2,B2)+||max,=i „, |(/Jv),| ^ Lfmax, and the 

assertion follows immediately. □ 



This controller resembles in part the Ackermann's formula in standard linear control theory 
[Franklin et al., 2006, p. 477] employed in unconstrained deadbeat controllers. 



CONTROLLING STOCHASTIC LINEAR SYSTEMS OVER NOISY CONTROL CHANNELS 



9 



Lemma 4.3. Given the system (2), suppose that Assumption 2.2 holds, and consider 
the decomposition (6). Then there exists M > such that 

4 



(2) 
Sc(f+1) 



,(2) I 



\\xf^\\ ||xf/||] ^ M for all t e Nq. 



Proof. We retain the notation from the proof of Lemma 4.2 and the 

definition of Uxt from (9). Fix t e Nq. Observe that since A2 is orthogonal, ||x^^j 



(2) II - 



1 1 t2) 1 1 

AjXj^j , and therefore. 



Ellllx*'' 

'^ll"'^K(t+l) 



- X 



,(2) I 



K-"ll}„=o] 



,(2) 

Kf:K(f+l)-l 



11^2'^ Id I 



III'SIIIIJ 

• 1 

n=Ol 



= E[||9I.(A2,B2)«,. + 9?.(A2,l2)^ll.,,i,_i|f IllkSllll^J- 
By Assumption 2.2-(iv), ||Mf|| < yfmUmax diam(T), which implies that 

e[||5R.(A2,B2)m,, + 5?.(A2,l2)<l(,,„_X I 

< e[(k V^U„axdiam(T) P,(A2,B2)|| + ||9l.(A2,l2)ll | 

Noting that ^fl^^t+iyi independent of , • • • , in view of Assumption 
2.2-(iii), applying Jensen's inequality to the right-hand side above yields 



e[(k V^U^axdiam(T) P,(A2,B2)|| + P,(A2,l2 



w 



(2) 

Kf:K(t+l)- 



-.1)'] 



= e[(k V^!J„,ax diam(T) WMi, Bi)]] + k P,-(A2,l2)ll Mt\\f] 
< K^(V^!J„axdiam(T)P,(A2,B2)|| + Pk(A2, 12)11 Q)'. 

The assertion follows at once with M equal to the right-hand side of the last 
inequality. □ 

Proof of Proposition 3.2. From (6) we see that the system splits into two parts, x^^^ 
and x^-^\ with the sequence {xf^)tf=f^^ describing the evolution of the Schur stable 
component of the state, and (xj )t€N„ describing the evolution of the orthogonal 
component of the state. It is well-known that (x^ )teNo is mean-square bounded so 
long as the control is bounded, which by Assumption 3.1-(vi) clearly holds (i.e., 

there exists C*^' > such that Ex[||x|^^||^] < C*^' for all t e No). It thus suffices to 

concentrate on (xf ^)fg]No. We let £,t := ||^Kf^|| for each t e Nq. We see that: 

o the condition (7) of Proposition 4.1 holds with / = r, where r is as defined in (11), 

by Lemma 4.2, and 
o the condition (8) of Proposition 4.1 holds by Lemma 4.3. 

Defining / := max|||x|)^'|| ,r|, we see that by Proposition 4.1 there exists a Cp'' = 



CP-\a,M,}) such that Ej [||xfj^|| ] < C*^' for all t e Nq. Since the subsampled process 
(x[^j')fg]N(, is mean-square bounded, and x^^^ is generated by a linear dynamical 
system, we conclude that there exists C'^' > such that Ev|^||xP|| j ^ C^^^ for all 
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t e Nq. The assertion of Proposition 3.2 follows with C C^^' + C^^^ and noticing 
that a and / depend on x, k, ^y, W and Ci. □ 

Proof of Proposition 3.5. Let gf := ct(x„, n = 0,1,..., t). Let us consider the k- 
subsampled system 

where UKt:K{t+i)-i ■= ["L ■ ■ • "K(f+i)-i] • this subsampled system we propose 
the control policy: 

(13) w.t:.(t+i)-i = -3?.(A2, sat,(A^x^'/), 

for some r > to be defined shortly. Let us verify the conditions of Proposition 
4.1 for the process (||^Kt^||)jgj]^ under the control policy proposed above. We see 
immediately that 

L|| K(f+l)|| II Kt IIJ 

< E5-[||A^^X<^' +5R,,(A2,B2)v,,M,,,,(t+l)_l||] - ||x^'/|| + E[||9i,(A2j2)w^K*:.(t+l)-l||] 

= p fA^^x^f/ + 5?,(A2,B2)w,,,(i+i)-i|| + (1 - p) IK^xf^'ll - 

+ E[||5?^-(A2, l2)zV„t:K(t+l)-l II] 
= P(IK4'' + 9l,,(A2,B2)WKt:K(W)-l|| - ||x|'^||) + V^I|9JK(A2,-f2)l|Ci 
= V^P,,(A2,l2)l|Ci, 

where we have employed orthogonality of A2 to arrive at the second equality above. 
By Assumption 3.4-(vii') we see that there exists a > such that ||9iK:(^2/B2)"^|| {a + 

VkCi mM2,h)\\ Ip) ^ !imax. Letting r := a + yfl^Ci P^.(A2J2)II /p, we see that 
the condition (7) is verified with / :- r. The condition (8) follows readily from 
Lemma 4.3, since the elements of the control input are uniformly bounded. Letting 
/ := maxjr, ||^|f^||}/ we see that by Proposition (4.1) there exists a constant CP'^ > 

such that E.v[||xf' II ] < [p^ for all t e Nq. By the same argument involving the 
Schur stable part x^^' as in the proof of Proposition 3.2, we see that there exists a 
constant C' > such that Ej[||Xf|p] < Q' for all t e No, concluding the proof. □ 
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